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Description 

This application is a division from patent appiication EP— A— 33 510. 

The invention described herein relates to a speech synthesis system as defined in the pre- 
5 characterizing part of claim 1. More specifically, this invention relates to the following aspects of a speech 
synthesis system: 

interpolation circuitry utilized to increase the effective data rate in speech synthesis circuits; and 
data frame rate control in speech synthesis circuits. 

Several techniques are known in the prior art for digitizing human speech. For example, pulse code 

io modulation, differential pulse code modulation, adaptive predictive coding, delta modulation, channel 
vocoders, cepstrum vocoders, formant vocoders, voice excited vocoders, and linear predictive coding 
techniques of speech digitization are known. The techniques are briefly explained in "Voice Signals; Bit by 
Bit" on pages 28—34 of the October, 1973 issue of IEEE Spectrum. 

In certain applications and particularly those in which digitized speech is to be stored in a memory, 

15 most researchers tend to use the linear predictive coding technique because it produces a very high quality : * 

speech using rather low data rates. A speech synthesis system employing the linear predictive coding 
technique would typically utilize frames of data which are comprised of digital representations of pitch, 
energy, and certain linear predictive coefficients which are utilized to control a digital filter. High quality \J 
synthetic human speech may be produced by such a speech synthesis system at a relatively low data rate, 

20 such as 1,200 bits per second, ultilizing a fixed rate of data frame entry. It will be appreciated that a more 
accurate representation of human speech may be obtained by increasing the frame rate to a significantly 
higher level. However, such an increase in the frame rate is accompanied by a corresponding increase in 
the number of bits which must be stored in memory to synthesize a given quantity of human speech. 
Further, because certain aspects of human speech are quite redundant, accurate synthesization of such 

25 redundant human speech can be achieved by utilizing a data rate significantly lower than that which would 
be normally employed. An ideal solution to the aforementioned problem, would require a speech synthesis 
system capable of synthesizing human speech from frames of data which change rapidly during those 
complex periods of human speech and change slowly during redundant periods, thereby minimizing the 
required bit storage. 

30 A problem encountered in attempting to utilize variable frame rate data in speech synthesis circuits 
occurs when interpolation calculation is utilized between frames of data to enhance data rate capability. A 
fixed interpolation system wherein eight interpolation calculations take place between each frame of data 
is adequate for fixed frame rate systems; however, a variable frame rate system requires much more 
sophistication in interpolation circuitry. Specifically, during slowly changing periods of speech data, a more 

35' accurate portrayal of the human speech waveform may be achieved by increasing the number of 
interpolation steps between frames. Conversely, during rapidly changing aspects of human speech, few or 
no interpolations between frames of data are required to accurately synthesize human speech. Thus, in 
order to solve the aforementioned problem, a speech synthesis circuit must be able to vary the number of 
interpolation calculations taken between successive frames of speech data. Further, it has been discovered 

40 that in certain aspects of synthesis of human speech, the interpolation between frames of data may more 
accurately portray human speech if interpolated linearly, or in other circumstances, non-linear 
interpolation may provide greater accuracy. 

In accordance with one aspect of the invention, a speech synthesis system is constructed with a linear 
predictive filter utilizing coded reflection coefficients to produce digital signals representative of human 

45 speech. A variable interpolation circuit within the linear predictive filter allows a variable number of 
interpolation steps to be calculated between successive values of reflection coefficients. Additionally, a 
user programmable option allows the user to select a linear, nonlinear, or combination form of 
interpolation. 

As previously described, speech synthesis if carried out at an increased data rate would typically ^ % 

so require a corresponding increase in the number of bits to be stored in a memory to synthesize a given 
quantity of human speech. To reduce the bit storage requirements of the memory while maintaining the 
capability of speech synthesis at a relatively high data rate is the subject of two papers delivered at the 1977 \ 
IEEE Conference on Acoustics, Speech and Signal Processing, and published in the record thereof. One ** 
attempted solution was suggested in "Variable-to-Fixed Rate Conversion of Narrowband LPC Speech" by 

55 E. Blackman, R. Viswanathan and J. Makhoul. The aforementioned solution required transmission of pitch, 
gain and reflection coefficients in three separate variable rates, with separate transmission criterion and a 
three bit header code to distinguish transmissions. Additionally, transmit and receive buffers were 
necessary in that system to convert the transmission back into a fixed rate signal. The second attempted 
solution was documented in a paper entitled "The Application of a Functional/Perceptual Model of Speech 

60 to Variable-Rate LPC Systems" by R. Visanwanthan, J. Makhoul and R. Wicks. This second solution 
involved the transmission of pitch and gain information at a fixed frame rate, and utilizing a variable frame 
rate for transmission of reflection coefficients. 

The above described problems are overcome in a speech synthesis system of the type defined in the 
. pre-characterizing part of claim 1 by incorporating the features of the characterizing part thereof. 

65 The novel features believed characteristic of the invention are set forth in the appended claims. The 
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invention itself, however, as well as a preferred mode of use, further objects and advantages thereof, will 
best be understood by reference to the following detailed description of an illustrative embodiment when 
read in conjunction with the accompanying drawings, wherein: 

Figure 1a is a view of an electronic learning aid which is a suitable structure for enclosing the speech 
5 synthesizer system; 

Figure 1b is a generalized block diagram of a speech synthesis system; 

Figures 2a and 2b form a detailed block diagram of the speech synthesizer; 

Figure 3 is a logic diagram of the input data register and frame control PLA; 

Figure 4 is a logic diagram of the interpolation counter circuitry; 
to Figure 5 is a detailed logic diagram of the speak latch circuitry and status latch circuitry. 

Figure 6 is a detailed logic diagram of the instruction decoder circuitry. 

Figure 7 is a detailed logic diagram of the parameter load control circuitry. 

Figures 8a and 8b form a composite block diagram of the array multiplier; 

Figures 9a — 9d are detailed logic diagrams of the blocks which form the array multiplier. 
15 Figures 10a — 10c are detailed logic diagrams of the recoding logic; 

Figure 11 is a detailed logic diagram of the filter adder; 

Figure 12 is a detailed logic diagram of one cell of the B-Stack, PPC, Y Latch register; 
Figure 13 is a detailed logic diagram of multiplex 58 and register 66; 

Figures 14a and 14b are detailed logic diagrams of the digital-to-analog and output circuitry. 

20 Referring to Figure 1 a, there is shown an electronic learning aid which may serve as a suitable structure 
for enclosing the speech synthesis system of the present invention. Figure 1b shows a generalized block 
diagram of the major components which make up such a learning aid. Keyboard 16 may be a standard 
matrix keyboard such as the type disclosed in U.S. Patent No. 4,074,055. Various algorithms required to 
implement the desired modes of operation of an electronic learning aid, electronic language translator or 

25 other applications may be programmed into the microprocessor in a manner well known in the art. An 
example of one such algorithm may be seen In US— A— 4 209 836. 

Data ROM 12 is a standard non-volatile Read Only Memory such as is described in US— A — 4 209 836. 
The coded or uncoded filter parameters which are utilized to control synthesizer 10 are stored therein. 
Synthesizer 10 is a linear predictive filter type synthesizer such as is described in DE — A 28 26 570; 

30 however, improvements in the synthesizer circuitry which result in higher quality speech, lower data rates 
and smaller circuit size are incorporated herein. Synthesizer 10 is controlled by microprocessor 14, and 
generates synthetic speech at speaker 18 by utilization of certain filter parameters stored in ROM 12. While 
synthesizer 10 is shown being controlled by microprocessor 14, it will be understood by those skilled in the 
art that any digital control mechanism may control synthesizer 10. In an embodiment disclosed herein, in 

35 .which synthesizer 10 is implemented in complementary MIS, such as CMOS, it is preferable that 
microprocessor 14 also be implemented in CMOS to permit both devices to be operated from a single low 
voltage source, such as a battery. The linear predictive filter utilized in synthesizer 10 is a single multiplier, 
lattice type filter similar to the filter described in DE— A— 28 26 570. The reader is encouraged to read the 
aforementioned German Patent Application to familarize himself with the basic operation of this complex 

40 circuitry. 

Referring to Rgures 2a and 2b, there is shown a detailed block diagram of synthesizer 10. Most of the 
blocks of Rgures 2a and 2b are shown in greater detail in later figures. 

Speech data, comprising either coded or uncoded filter coefficients, is received by synthesizer 10 from 
ROM 12 at the Data In pad of input register 22, input register 22 is a ten bit register latch which accepts the 
45 speech data serially and outputs the data in parallel to frame control PLA 30. 

Input/output pads 1, 2, 4 and 8 accept control data from microprocessor 14, and input the control data 
to instruction decoder 20. Input/output pads 1, 2, 4 and 8 are bidirectional lines and microprocessor 14 is 
therefore able to access speech data out of input register 22 as in an alternate embodiment wherein a 
control mechanism may be utilized to examine such data. Instruction decoder 20 is utilized to decode the 
50 instructions which microprocessor 14 inputs to synthesizer 10. Instruction decoder 20 also set speak latch 
24 and parameter load control 26. Speak latch 24 generates logic signals which are utilized throughout 
synthesizer 10 to indicate that synthetic speech is being generated. Parameter load control 26 is utilized to 
control the loading of data into input register 22. In addition to instruction control of parameter load control 
26, the status latch 28 is also capable of controlling the input of data to input register 22 by detecting certain 
55 special states of input data which will later be described in detail. 

Frame control PLA 30 is utilized to decode the aforementioned special states of input data which in turn 
set the special state latches in status latch 28. Frame control PLA 30 also decodes special states of the input 
data which control how many interpolation steps take place between each frame of data, thereby allowing 
synthesizer 10 to vary the rate at which data is applied. Interpolation counter 34 is utilized to generate a 
30 signal which controls the number of interpolation steps which will be calculated between adjacent frames. 

Code RAM 32 is a twelve by ten bit RAM utilized to store an entire frame of data. An entire frame of data 
will include a pitch parameter, an energy parameter and ten filter parameters. The maximum length of an 
uncoded parameter is ten bits, and twelve parameters are normally required for each frame. 

In one mode of operation, synthesizer 10 generates synthetic speech from uncoded parameters. These 
65 parameters are transferred from code RAM 32 to the ROM/RAM load, parallel/serial converter 38, to be 
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serially loaded out to the linear predictive filter. In the alternative mode of operation the coded parameters 
are utilized by address PLA 36 to generate an address for the appropriate uncoded parameter stored in 
parameter ROM 40. The uncoded parameters from ROM 40 are inputted to converter 38 and then serially 
loaded out to the linear predictive filter. 

5 The parameters outputted from converter 38 are coupled into array multiplier/interpolator 50. Array 
multiplier/interpolator 50 functions similarly to the array multiplier of US A 4 209 844, with the 
additional capability of conducting interpolation steps. Array multiplier/interpolator 50 is coupled to filter 
adder 54, which is utilized to perform the additions and subtractions necessary to implement the filter 
function. The output of adder 54 is coupled to B stack, PPC register and Y latch register 56 and to 

w multiplexer 58. Register 56 serves as a temporary store for those intermediate values necessary to perform 
the filter calculations, and storing the pitch period count (PPC). Register 56 also serves to drive D to A 
converter 64 with appropriate output values. D to A converter 64 converts the output of the filter to analog 
signals which drive speaker 18. Multiplexer 58 serves to couple information back up into multiplier/ 
interpolator 50 through recoding logic 52 from adder 54 or the multipurpose shift register 66. 

Shift register 66 is a multipurpose shift register utilized to couple excitation data or scale data from v * 

ROM 78 into multiplier/interpolator 50 through multiplexer 58 and recoding logic 52. Scale data is utilized 
by multiplier/interpolator 50 to perform interpolation. Additionally, shift register 66 couples pitch period 
counter (PPC) information which is utilized to address excitation data in ROM 78. Pitch period counter * 
information is coupled through multiplex 70 to address register 72 where it is utilized to address excitation 

20 data in ROM 78. Unvoiced address generator 76 is utilized during unvoiced periods of speech to randomly 
address one of two excitation values, utilized during unvoiced speech, which are stored in ROM 78. 

Tri-state buffer 68, in an alternative embodiment of the present invention, it utilized to control the 
excitation input to shift register 66. Synthesizer 10 may be utilized as a residually excited synthesizer, in a 
vocoder application, for example. In such an alternative embodiment a residual excitation signal is applied 

25 to residual input pin 80, and tri-state buffer 68 is disabled by a control signal at residual control pin 82. In 
this alternative embodiment, parameters are inputted to multiplier/interpolator 50 from an external source, 
rather than through converter 38. 

The synthesizer 10 is preferably implemented using precharged conditional discharge type logics. 
Thus, four clock signals, 01 — 04 are appropriate for use in such precharge, conditional discharge logic. 

30 There are two main clock phases (01 and 02) and two precharge clock phases (03 and 04). Phase 03 goes 
high during the first half of phase 01 and serves as a precharge therefor. Phase 04 goes high during the 
first half of phase 02 and serves as a precharge therefor. A set of clocks 01 — 04 is required to clock one bit 
of data, and thus correspond to one time period. 

Timing signals, labelled Ti — T22, each having a period on the order of 4.5 microseconds are' utilized 

35 throughout the system. Selecting a time period on the order of 4.5 microseconds permits data to be 
outputted from synthesizer 10 at a 10 kilo hertz rate (i.e. at a 100 microsecond period) which provides for a 
frequency response of 5 kilohertz in the digital-to-analog converter 64. It will be appreciated by those skilled 
in the art, however, that depending upon the frequency response desired, the number of reflection 
coefficients utilized and the type of logics utilized, the periods or frequencies of the clocks and clock phases 

40 may be substantially altered. 

Thirteen parameter count (PC) signals are also utilized in the depicted embodiment of the invention. 
The first twelve of these, PC=0 through PC=11 correspond to the times when the energy, pitch, and 
K1— K10 reflection coefficients are available in parallel-serial converter 38, Each of the first twelve 
parameter counts comprise two cycles, referred to as the A and B cycles. Each cycle, whether A or B, begins 

4$ at T18 and ends at the next T18. During each parameter count the value in parallel-serial converter 38 is 
utilized as a target value for interpolation with an existing value stored in a recirculating portion of 
multiplier interpolator 50. During the A cycle, the appropriate existing parameter is withdrawn from the 
recirculating portion of multiplier/interpolator 50, and during the B cycle the newly interpolated value is 
reinserted. ~ 

so The thirteenth parameter count, PC=12, is provided for timing purposes so that all twelve parameters 
are interpolated once each 2.5 millisecond, and for indicating that period of time during which variable 
frame rate data is inputted. \ 
As was discussed earlier with respect to interpolation, the synthesizer of the present invention is * 
capable of performing from zero to one hundred twenty seven interpolations between each frame of 

55 parameters inputted. A new interpolation count signal is available from interpolation counter 34 every 2.5 
milliseconds, and is utilized to address a scale value in excitation/scale ROM 78. Thus the period for 
interpolation remains constant at 2.5 milliseconds, regardless of the number of Interpolation steps between 
two values. 

New parameters may be inputted to synthesizer 10 at a fifty hertz frame rate. It will be seen 
60 subsequently that in multiplier/interpolator 50, the pitch data, energy data and reflection coefficients are 
utilized as ten bit binary numbers. If each of the twelve parameters were updated with a ten bit binary 
number at a fifty hertz rate, a 12x10x50, or 6,000 hertz bit rate would result. Therefore, in order to lower the 
bit rate, the data compression scheme of US — A — 4 209 836 may be utilized. In Figure 6 of US— A— 4 209 
836, there is shown pictortally a representation at four different lengths of data frames. One frame, labelled 
65 "voiced frame" has a length of 49 bits, while another labelled "unvoiced frame", has a length of 28 bits. A 
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"repeat frame" has on!y ten bits and a "zero energy" frame has only 4 bits. In an alternative embodiment, a 
direct, uncoded, ten bit binary number may be loaded for each parameter. The input circuitry of synthesizer 
10 is capable of accepting either format. 

Various portions of synthesizer 10 will now be described in detail with reference to Figures 3 through 

5 14, which depict in detail the logic circuits which implement synthesizer 10. Certain well known sections of 
the block diagram depicted in Figures 2a and 2b are not included in Figures 3—14. The following 
discussion, with reference to Figures 3—14, refers to logic signals available at many points in the circuit. 
Synthesizer 10, in this embodiment disclosed, is implemented in complementary MIS, such as CMOS. It 
must be remembered that in CMOS devices, a logic zero corresponds to a zero voltage, that is Vss. Further, 

to the P channel devices depicted in the aforementioned figures are conductive when a logic zero is applied to 
their respective gates. Also, a logic one in CMOS devices corresponds to a positive voltage, +3V in the 
embodiment disclosed (Vdd), Therefore, the N channel devices depicted are conductive when a logic one is 
applied to their respective gates. When a logic signal is referred to which is unbarred, the signal is to be 
interpreted as 'True" logic, that is, a binary one indicates the presence of Vdd and a binary zero indicates 

is the presence of Vss. Logic signals which are barred indicate "False" logic and the aforementioned 
relationships are reversed. It should also be understood that a numeral in a clocked gate indicates which of 
the clock phases is utilized, as a precharge clock. The letter "S" in a gate indicates the gate is statically 
operated. 

Referring to Figure 3, there is shown a logic diagram of input data register 22. Input data register 22 is a 
20 ten stage register, the first stage of which is shown within the detail marked A. Input data register 22 is ten 
stages in length to allow synthesizer 10 to accommodate uncoded parameters up to ten bits long, or, in an 
alternative embodiment, coded parameters of the type utilized in US — A— 4 209 836. 

Certain signals are utilized to control input data register 22. A clear signal (CLR) is generated by 
parameter load control 26, and is utilized to clear input data register 22 at time T22, during speech. The IO, 
25 ROM control signal, is delayed to form IOD, which is utilized to clock bits of data into input data register 22. 
An optional control signal, HC, is utilized as a modified Huffman code. This signal is utilized during variable 
frame rate operation to control the receipt of the Huffman code, which, those skilled in the art will recall, is a 
variable length code. 

Frame control PLA 30 is shown in Figure 3. PLA 30 is a programmable PLA, and is therefore shown 
30 without gates. PLA 30 is utilized to detect certain special states which occur in the input data. Among those 
special states are those which effect the length of each individual frame, including: the Repeat state (RPT); 
the "Energy equal zero" state (E=0>; the "Pitch equal zero" state {P=0k and the "End of File" or "Energy 
equal fifteen" state (E=15). 

Additionally, the lower half of PLA 30 also decodes the Huffman code mentioned earlier, or a standard 
35 binary code, either of which may be utilized during variable frame rate operation. The decoded variable 
frame rate data is utilized to generate the signals ICP6— ICP0, which are in turn utilized to control 
interpolation counter 34. The parameters in input data register 22 are also passed through PLA 30 to the 
parameter RAM 32. These signals are shown in DI0— DI9. 

Interpolation counter 34 is shown in detail in Figure 4. Previous attempts at variable frame rate voice 
40 synthesis have had difficulty due to the problem of varying lengths of time between each frame, and the 
question of interpolation therein. Interpolation counter 34 is capable of utilizing the variable frame length 
data to control the number of interpolation steps between each frame. Thus, during rapidly changing 
speech, few or no interpolations take place between data frames. However, during slowly changing speech, 
• up to one hundred twenty seven interpolations may take place. 

45 Register 343 is a seven stage shift register, which is initially set by the signals ICP6 — ICP0. The first 
stage of register 343 is shown within the detail marked "A". The signals ICP6— ICP0 initially set register 343 
to some number, the interpolation count, which is between zero and one hundred twenty seven. The 
interpolation count initially set into register 343 is clocked out and around through a series of inverters 
which generate an appropriate amount of delay. Gates 344 are utilized to selectively increment the 

so interpolation count after each interpolation. The new interpolation count is then shifted back into register 
343, whose gate 341 is utilized to detect the "interpolation count equal zero" (IC=0) state. When the IC=0 
state is detected, gates 342 are utilized to latch this condition. The IC=0 condition is utilized throughout 
synthesizer 1 0 to indicate the end of interpolation, and allow the entry of new data. The interpolation count 
is outputted from interpolation counter 34 to be utilized as part of the address in excitation/scale ROM 78. 

55 Figttre 5 shows a detailed logic diagram of speak latch 24. Speak latch 24 consists of four latch circuits 
utilized to set and hold signals which indicate synthesizer 10 is generating speech. Gates 241 form a latch 
which has SPK as its input SPK is generated by instruction decoder 20 in response to an input command 
which causes speech to be generated utilizing coded speech parameters. Instruction decoder 20 may also 
generate SPKEXT in response to an input command which causes speech to be generated utilizing 

so uncoded, ten bit, binary parameters, as discussed earlier with respect to an alternate method of operation. 
The SPK command is utilized to generate the "speak enable" (SPKE) command out of gates 241, and to set * 
latch 242 to generate SPKL The SPKEXT command will set a latch 244 comprised of gates 243, which in 
turn will set latch 244 and generate SPKEXTL. The occurrence of either SPKEXTL or SPKL will in turn 
generate the TALK signal. Gate 245 is utilized to reset the latches comprised of gates 241 and 243 during a 

65 power up, or after a reset signal. The speak reset (SPRST) command is generated by gate 246 by receipt of 
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an "end of file" or "Energy equal fifteen" (E=15) code. Additionally, gate 247 is utilized to latch out a "talk 
status" signal which indicates synthesizer 10 is generating speech. Thus, the logic signals outputted by 
speak latch 24 are utilized throughout synthesizer 10 to indicate the generation of speech. 

Status Latches 28 are also shown in detail in Rgure 5. The function of the various status latches is 

s identical to the function described in US— A— 4 209 836, and will only be described briefly herein. 
Latching signal LATCH 1 is generated by gate 281 at the beginning of a frame of data, the inputs to gate 
281 all signifying a frame start. The LATCH 1 signal will strobe any SPKEXTL or SPKL signal at latch 244 or 
242 in the speak latch 24, and will additionally strobe the output of latches 289 (the "Pitch equal zero" (P-0 
latch) and 290 (the "Energy equal zero" (E=0) latch into latches 284 and 285 to generate Old E=0 and Old 
P=0. The contents of latches 284 and 285 are utilized in conjunction with the P=0 signal to generate the 
INHIBIT signal. As in the synthesizer of US— A— 4 209 836 the INHIBIT signal is utilized to inhibit 
interpolations in certain conditions. During transition from voiced to unvoiced speech, or unvoiced to 
voiced speech, it is advantageous to insert new parameters directly, without interpolations. Also, 
interpolations are not desirable when transitioning from silence to speech. 

w As was explained in detail in US — A— 4 209 836 it has been determined that fewer parameters are 
required to accurately represent unvoiced speech. Therefore, gate 288 is utilized to generate a "zero 
parameter" (ZPAR) signal during unvoiced speech (Old pitch equal zero) after the parameter count has 
reached five (PC 5). Gate 288 also zeroes all parameters during non-speaking periods, by utilizing the TALK 
signal and the TALKD signal generated by latch 283. 

20 Referring to Figure 6, there is shown a detailed logic diagram of instruction decoder 20. Instructions 
from microprocessor 14 are input to synthesizer 10 on I/O pins 1/01, 1/02 and 1/04. The instructions are 
clocked in each time a Processor Data Clock (PDC) signal is generated. The instructions are decoded by PLA 
202. Many of the instructions are identical to those utilized by the synthesizer of US — A— 4 209 836. A brief 
description of each instruction and its function is listed below. 

25 The "Reset" (RST) instruction is a software reset instruction which is utilized by gate 201 in conjunction 
with the synthesizer "power up clear" (PUC) signal to form PUC+RST. This instruction is then utilized to 
reset speak latch 24. 

The "Read" (READ) instruction is a signal from microprocessor 14 telling synthesizer 10 to access one 
data bit from ROM 12. 

30 The "Load Address" (LA) instruction is an instruction which requires two PDC signals to execute. On 
the first PDC, the LA instruction is latched into latch 203. Latch 203 disables PLA 202 so that no command is 
decoded. On the second PDC, gate 205 is enabled, causing instruction decoder 20 to output an 11 signal to 
ROM 12. The 11 signal instructs ROM 12 to load four bits of address. 

The "Speak" (SPK) instruction causes synthesizer 10 to begin synthesizing speech utilizing coded 

35 speech parameters. The SPK instruction is utilized throughout synthesizer 10. 

The "Speak External" (SPKEXT) instruction causes synthesizer 10 to begin synthesizing speech 
utilizing direct, uncoded, parameter loading, as in the alternate embodiment discussed herein. 

The "Read and Branch" (R+B) instruction is an instruction to ROM 12 to internally read data and load 
the data back into its address register, to allow indirect addressing. 

40 The 'Test Talk" (TTALK) instruction and the "output" (OUTPUT) instruction both require three PDC 
signals to execute. The TTALK instruction sets latch 206 and disables PLA 202 through gate 240. On the next 
PDC, the output of latch 206 is clocked through gate 208 to generate signal C2. Signal 02 is utilized to 
control the buffer between I/08 and IR9, allowing the "talk status" (TALKST) signal to be output on 1/08. 
Thus, microprocessor 14 can determine whether synthesizer 10 is talking. The next PDC signal shuts off the 

45 C2 signal and resets latch 206. The OUTPUT instruction also requires three PDC signals to execute. Latch 
207 and gate 209 interact in the same manner as latch 206 and gate 208. However, in the case of the 
OUTPUT instruction, a C1 signal is generated which enables the buffer to all of the I/O pads. In this manner, 
microprocessor 14 can access data in ROM 12, through synthesizer 10. 

Detail diagrams of the buffers for the I/O pads are also shown in Figure 6b. 

so Parameter load control 26 is shown in detail in Figure 7. Parameter load control 26 generates the IO 
signal to ROM 12. The 10 signal and the 11 signal, generated by instruction decoder 20, control ROM 12 in 
the manner described in US— A—4 209 836. The 10 signal is utilized to clock data out of ROM 12. 

Gate 261 is utilized to generate the Parameter Load Enable (PLEN) signal which allows parameters to 
be written into code RAM 32. PLEN is generated unless one of three conditions exist at the input of gate 

55 261. When a repeat (RPT) bit is detected, the PLEN signal stops. A RPT bit is utilized-when old parameters 
are to be repeated, thus no new parameters should be loaded. When the Energy parameter is zero (E=0), 
indicating silence, the PLEN signal is disabled. Lastly, as described in US— A— 4 209 836, during unvoiced 
speech the system utilizes fewer parameters to accurately represent speech. Thus, when the pitch 
parameter is equal zero (P=0) and the parameter count indicates that the first six parameters have been 

bo loaded (PC>5), PLEN is disabled. 

Gate 262 is utilized during variable frame rate operation to allow the frame rate data to be loaded (at 
PC=12) despite a condition which would preclude loading parameters. Gate 266 is utilized to set latch 263, 
the output of which is utilized in conjunction with the even clock times (TEVEN) by gate 264 to generate 10 
signals. Gate 266 is utilized to distinguish between loading coded or direct parameters, since in the 

65 embodiment disclosed coded parameters consist of two to seven bits and direct parameters consist of ten 
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bits. Gate 265 is utilized to reset latch 263. Gate 267 is utilized to generate the CLR signal which clears the 
Input register. 

Recoding logic 52 couples the outputs of multiplexor 58 to multiplier/interpolator 50. Recoding logic 52 
* is shown in detail in Figures 10a— d. Recoding logic 52 consists of six stages, three of which are identical, as 

s seen in Rgure 10b. The first stage of recoding logic 52 (labelled REL 20) generates signals for the first two 
stages of multiplier/interpolator 50. The subscripts on each control signal indicate to which stage of 
multiplier/interpolator 50 it is coupled. The third stage of multiplier/interpolator 50 and the seventh stage 
require additional control signals due to the interpolation function therein. The INT signal discussed in the 
interpolation section is generated in the section of reading logic 52 labelled REL 30 in Figure 10a, and the 

io T18 signal for the seventh stage is generated by the stage labelled REL 50 in Rgure 10c. Recoding logic 52 
outputs +2,~ = Z +1 and -1 to each stage of multiplier/interpolator 50 with the exception of stage one 
which receives only +1, -1, and -2 outputs. Effectively, as seen in US-A^-4 209 836, recording logic 52 
permits multiplier/interpolator 50 to process, in each stage thereof, two bits of information in lieu of one, by 
utilizing Booth's Algorithm. Booth's Algorithm is explained in 'Theory and Application of Digital Signal 

15 Processing", published by Prentice-Hall 1975, at pp. 517-18. 

A block diagram of multiplier/interpolator 50 is formed by the composite of Figures 8a and 8b. 
Multiplier/interpolator 50 is an array multiplier. Array multipliers are sometimes referred to as "Pipeline 
Multipliers". For example, see "Pipeline Multiplier" by Granville Ott, published by the University of 
Missouri. Multiplier/interpolator 50 has seven stages, stage 1 through 7 and operates similar to the array 

20 multiplier disclosed in the aforementioned US— A— 4 209 844. The equations in Table I herein represent the 
operation of the digital filter wherein multiplier/interpolator 50 and filter adder 54 are utilized to solve these 
equations. 

The inputs to multiplier/interpolator 50 are the ta rget values for new parameters, input at the 
PROMOUT terminal of the first stage, the aforementioned +1, -1, +2 and^^S signals from recoding logic 

25 52, and the INT a nd TPAR si gnals fro m recoding logic 52. The outputs of multiplier/interpolator 50, MULT 
0— MULT 13 and PITCH 0 — PITCH 9 are applied to filter adder 54. The blocks which make up individual 
sections of each stage are labelled A-1, B-1 through B-5, C-1 through C-3 and D-1 and D-2. The detailed logic 
diagrams of each block section are shown in Figures 9a — 9d. The operation of multiplier/interpolator 50 is 
identical to that of the multiplier in US — A — 4 209 836, with the exception of additional interpolation 

30 circuitry which will be explained with reference to Figures 8a and 8b and also 9a — 9d. 

The first stage of multiplier/interpolator 50 is comprised of nine A-1 blocks, with an add itional bit of 
storage in the two inverters on its input and are thus responsive to the TPAR signal and to -1, +1, -2 
signals output from recoding logic 52. When multiplications occur in multiplier interpolator 50, the most 
significant bit is always maintained in the left most column elements while the partial sums are 

35 continuously shifted toward the right. Inasmuch as each stage of multiplier/interpolator operates on two 
binary bits, the partial sums, labelled E are each shifted to the right two places. Thus, a total capacity of ten 
bits is available. As explained earlier, whether coded or direct parameters are utilized, the parameters 
utilized in multiplier/interpolator 50 are ten bits in length, due to the decoding of any coded values by 
address PLA 36 and ROM 40. The ten bit parameters which are loaded into multiplier/interpolator 50 

40 represent the target values for current calculations. As the interpolation calculations reach these target 
values, the target values become current values, and new target values are loaded into multiplier/ 
interpolator 50 at the PROMOUT point. 

Current values for filter parameters are stored within multiplier/interpolator 50 in recirculating shift 
registers contained in alt but the most significant bit of each stage. The recirculating shift registers circulate 

45 out of B terminals of each block and into the A terminals of the block below. At the bottom or seventh stage, 
the values are circulated back up through the D terminals into the C terminals. The current values shifted 
into the A terminals of each block are the multiplicands. The multipliers are the values input to 
multiplier/interpolator 50 by recoding logic 52. 

The recirculating shift registers within multiplier/interpolator 50 form an eleven bit shift register, with 

so each parameter shifting by each eleven time periods. There are twenty-two time periods, and each 
parameter K1— K9 is utilized twice during filter calculations. Thus eighteen time periods are required for 
these nine parameters. The K10 value and the energy value, as disclosed In US— A— 4 209 836, are each 
utilized once in filter calculations, and are therefore swapped or exchanged, in the seventh stage of 
multiplier/interpolator 50, This requires two additional time periods. Of the two remaining time periods, 

55 one is utilized during interpolation, and the other is not utilized. 

In Figure 9d, there is shown a detailed logic diagram of blocks D2 and D1. In each of the D type blocks, 
there is shown a group of gates labelled 501. The leftmost, latch 501a is a recirculating latch wherein either 
K10 or the energy value is stored. The multiplex gate 501b, in gates 501 , is controlled by the signals labelled 
P' and E' which determine whether the signal outputted at the D terminal is the input from terminal A, or 

$o the contents of latch 501a. When the input signal at terminal A is the K10 parameter, it is stored in latch 
501a and the previous contents of latch 501a is output through multiplexer 501b. The output of multiplex 
gate 501b is coupled to terminal D through a transmission gate controlled by the signal labelled F. 

As discussed above, multiplier/interpolator 50 contains a recirculating shift register formed by vertical 
contacts between stages. The energy and K1 — K10 parameters, which represent the current values, are 

65 recirculating through this register, occupying twenty of the possible twenty-two time periods. In order to 
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perform interpolation, the current value of any given parameter must be captured and presented in the 
stage of multiplier/interpolator 50 to determine the difference between that current value and the target 
value being input at the appropriate time. Interpolation must take place when each target value is inputted, 
and not necessarily when the current value has circulated up to the proper position. The new current value 
s (Vn+1) represents the sum of the old current value (Vn) plus some scale factor (N) times the difference 
between the old current value (Vn) and the target value (V T ). N, the scale value is some fractional number 
stored in ROM 78 and utilized during variable interpolation. Thus the interpolation formula may be 
expressed: 

10 (D V n+1 «V n +N(V T -V 0 ) 

The sample of any given current value must therefore be stored until the unused time period which is 
utilized for interpolation. Each block in the seventh stage of multiplier/interpolator 50 has a storage latch 
502, wherein the current value is temporarily stored. When a parameter to be interpolated circulates into ^ 

15 the seventh stage D block, it passes through multiplex 501b and out through the D terminal, the value is 
also sampled through the transmission gate controlled by the signal N, and placed in storage latch 502. 
Storage latch 502 has a two input NOR gate on its recirculation line, the other input of which is the ZPAR 
signal utilized to zero parameters in specific states discussed above. Thus, the current value of the * 
parameter to be interpolated is temporarily stored in storage latch 502. At the appropriate time period (T7 

20 in the embodiment disclosed) the control signal labelled G is generated, and the contents of storage latch 
502 is output to the D terminal. Therefore, the recirculating shift registers in multiplier/interpolator 50 
contain the parameters K1— K9 an exchanged value representing K10 or Energy, and the about to be 
interpolated value of one of the parameters. The value to be interpolated is shifted up to the second stage 
of multiplier/interpolator 50 and, at the same time, the target value for that particular parameter is serially 

25 ' shifted into, the first stage. Recoding logic 52 provides a~^t signal to the second stage, which operates on 
the value to be interpolated, the result of which is then added to the target value, which generates V T -V„, 
for output at the 2 output terminal. 

The third through sixth stage of multiplier/interpolator 50 act as an eight by ten bit multiplier during the 
interpolation time period for multiplying the difference between the target value and the current value 

30 (V T -V„) times the scale value N. The various values for N are stored in ROM 78 and inputted to 
multiplier/interpolator 50 through recoding logic 52, from multiplex 58 and shift register 66 (as shown in 
Figure 2b). 

The third stage of multiplier/interpolator 50 is different from other stages due to the fact that the sum 
out of the second stage during interpolation is not merely added to the next calculation. In the interpolation 

35 operation^ is required that V T -V n be utilized as the multiplicand in order to be multiplied by scale factor N. 
Thus, the V T -V„ value must be substituted for the multiplicands which are normally inputted on the A 
terminal from the B terminal above, in the normal recirculating shift register operation described above. In 
order to accomplish this exchange, each of the C blocks of multiplier/interpolator 50, shown in Figure 9c, 
has a multiplex gate 503, controlled by the signal INT, which operates during the interpolation mode. When 

40 a V T -V n value is present in the second stage of multiplier/interpolator 50, the INT signal controls gates 503 
so that the signal at the E input terminal is selected by gate 503 and V T -V n is inserted into the recirculating 
shift register to be utilized as the multiplicand. The V T -V B value is inserted during one of the two unused 
time periods discussed above and therefore has no effect on the recirculating current parameter values. 
Since during interpolation, the third stage of multiplier/interpolator 50 is utilized as the first stage of an 

45 eight by ten bit multiplier, as discussed above, the input on the H terminal must be forced to zero. This is 
also accomplished by the INT signal coupling Vss into each C block at the H terminal. 

The V T -V n value is thus forced into the multiplicand position, and multiplied by the scale value N. 
Therefore the output of the sixth multiplier stage is the value N(V T -V n ). The seventh stage of 
multiplier/interpolator 50 is utilized to add the current value of a parameter to the recently calculated * 

so N(V T -V n ) value. As shown in the detail of the D blocks in Figure 9d, at time T1 8, the nor mal S input terminal 
is disabled and the E input is enabled through the bank of transmission gates depicted."7l8 also enables a 
transmission gate which allows the contents of storage latch 502 to be coupled to full adder 504. Thus the 
output of full adder 504 is the solution to Equation (1) or V n +N(N T -V n ). The output of full adder 504 is * 
coupled through a transmission gate controlled by the signal labelled I and coupled into storage latch 502. 

55 This is necessary since the newly interpolated value is always available at T19, due to the requirement that 
all interpolation calculations take place during the aforementioned window or open spot which occurs in 
the recirculating shift register. At the appropriate time, the contents of storage latch 502 is forced back into 
the recirculating shift register through a transmission gate controlled by the signal labelled G. A special 
case occurs at the last Interpolation prior to achieving the target value, or as described earlier herein, the 

so IC=0 state. To avoid the problems generated by slight errors which may cause the interpolated value to be 
slightly over or under the target value, a special case is utilized for the last interpolation or Interpolation 
count equal zero state (IC=0). As in normal Interpolation, the current value of a particular parameter is 
captured and inserted into the interpolation time period in the recirculating shift register. However, rather 
than being operated upon by the -1 signal from recoding logic 52, the current value is zeroed and then 

65 subtracted from the target value. The target value is then circulated down to the seventh stage of 
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multiplier/interpolator 50 where it is input on the A terminal. The signal is then shifted through multiplier 
501b in each block of the seventh stage, and inserted into storage latch 502 directly by way of a 
transmission gate controlled by a signal labelled H. Thus, rather than a newly interpolated value, during the 
last interpolation the target value itself is inserted into storage latch 502. Again as above, at the appropriate 

5 time the contents of storage latch 502 is inserted into the recirculating shift register to replace the old 
current value. This progress is repeated, and a new parameter is interpolated. 

A slightly different operation is utilized for interpolation of the pitch value. After a target value for pitch 
is input to multiplier/interpolator 50, it is circulated down through the recirculating shift register discussed 
above. Entering the seventh stage at the A terminal, it is passed through multiplex gate 501b and stored in 

io storage latch 502. If the value in storage latch 502 is a pitch value, it is stored in pitch latch 505. Each block of 
the seventh stage of multiplier/interpolator 50 has a latch 505 for storing one bit of the pitch value. The pitch 
latch 505 is controlled by the signals labelled M and N in Rgure 9d. Pitch latch 505 then stores the pitch 
value until the appropriate time, when the control sig nal label le d L allow s the pitch value to be outputted. 
The outputs of multiplier/interpolator 50 include PITCH 0 — PITCH 9, representative of the pitch value 

15 stored in the pitch latch formed by gates 505, and MULT 0 — MULT 13 which represents the intermediate 
products generated during filter operation. As shown in Figure 8b, the least significant bit of the MULT 
output (MULT 0) is forced to the value of the sign bit (MULTSN). This transaction is utilized to prevent the 
negative drift which normally results from simple truncation of a two's complement number. By forcing the 
least significant bit to the value of the sign bit, truncation is always toward zero. Those skilled in the art will 

20 appreciate that this truncation scheme will help avoid the "limit cycle" problem. 

Filter adder 54 is shown in Figure 11. The tenth and fourteenth block of filter adder 54 are showp in 
detail. Filter adder 54 is utilized to perform the additions and subtractions necessary to solve the equations 
listed in Table I. There are twenty additions or subtractions required to implement a ten pole filter, utilizing 
twenty of the twenty-two time periods. During the free time periods, filter adder 54 increments a pitch 

25 period counter signal and compares it to the pitch value inputted from multiplier/interpolator 50. The pitch 
period counter (PPC) is utilized to address periodic or voiced excitation values in ROM 78. When the PPC 
signal is equal to the pitch value, it is zeroed and begins incrementing again. A more detailed description of 
the PPC signal operation is listed below. 

B stack 56 is a temporary storage facility utilized to temporarily store those intermediate values or "b" 

30 values which are necessary to solve the equations listed in Table I. B stack 56 is shown in detail in Rgure 12. 
B stack 56 also provides temporary storage for the aforementioned PPC signal and the YLATCH signal 
which represents the output of the filter formed by multiplier/interpolator 50 and filter adder 56. The 
YLATCH output is coupled to the digital to analog converter and is utilized to generate analog signals 
representative of human voice. The PPC signal is output to multipurpose shift register 66 where it is utilized 

35 to address excitation values. 

The multipurpose shift register 66 and multiplex 58 are shown in Rgure 13, and two of the stages are 
shown in detail therein. Referring to the block diagram of Figure 2b and the equations of Table I will 
facilitate an understanding of the interworkings of the filter output circuitry. The MULT outputs from 
multiplier/interpolator 50 represent intermediate products required to solve the equations of Table I. Such 

40 products may be a K value times a b value, or a K value times a Y value. Rlter adder 56 then adds or 
subtracts the intermediate product from a Y value or a b value to obtain a Y value or a b value. B stack 56 is 
utilized to store these b values, since each b value is utilized in filter adder 56 to calculate the next b value. 
The PPC signal from B stack 56 is input to shift register 66 and output to multiplex 70. Multiplex 70, not 
shown in detail, utilizes the PPC signal to address voiced excitation values stored in ROM 78. Any 

45 conventional address scheme may be utilized. The values stored in ROM 78 represent a chirp function, as in 
US — A— 4 209 836, and it has been found that a chirp function closely models vocal cord excitation. 
Multipurpose shift register 66 also receives the aforementioned excitation values, or scale values 
addressed by an interpolation count signal from ROM 78 which are multiplexed out as MR signals to 
recoding logic 52. 

so The scale values stored in ROM 78 are chosen by the operator to generate any desired type of 
interpolation. As previously discussed, the IC or interpolation count may be any number from one to one 
hundred twenty seven. The IC count is utilized to address scale factors in ROM 78, thus, in the embodiment 
disclosed, up to one hundred twenty seven custom scaling values may be stored in ROM 78. A mask 
programmable option, or programmable type memory will allow easy substitution of scale values or 

55 excitation values. Scale values are typically fractional values utilized during interpolation of speech data 
and may be linearly or nonlinearly related. 

Another important feature of the excitation signals provided by ROM 78 concerns the capability of 
scaling unvoiced excitation. In previous speech synthesis systems, such as disclosed in US — A— 4 209 836 
the unvoiced excitation is characterized as white noise. Such an input may be generated in many ways, 

60 such as a constant value with a pseudorandom sign bit. This solution is quite adequate; however, the 
inability to scale the unvoiced excitation to the voiced excitation results in unbalanced excitation signals. 
ROM 78, in the embodiment disclosed, also stores two unvoiced excitation signals, of approximately equal 
value, and opposite sign. A random bit is generated by unvoiced address generator 76 and is utilized as one 
bit In the address of the two aforementioned unvoiced excitation signals. This allows great resolution of the 

65 level of the unvoiced excitation, and further, allows the operator to change the level or value to balance 
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excitation signals. Although ROM 78 is disclosed in the present embodiment as a Read Only Memory* those 
skilled in the art will appreciate that a Random Access Memory will provide an easier method of value 
changing than the mask programmable method required by a Read Only Memory. 

An alternate form of excitation is also available through tristate buffer 68, shown in Figure 2b. This gate 
s allows synthesizer 10 to be utilized as a residually excited synthesizer, in a vocoder application for example. 
Multiplex 58 is utilized to couple the newly calculated "b" values or Y values to receding logic 52. 
Multiplex 58 may also couple excitation values or scale values to recoding logic 52, the former for filter 
calculations, and the latter for interpolations. The outputs of multiplexer 58 are labelled MRO — MR12 and 
MRSN (for sign bit). 

io The digital-to-analog converter herein described is particularly well suited to low voltage applications 
and may be implemented in complementary MIS, such as CMOS, and may be integrated on a common 
semiconductor substrate with the CMOS synthesizer described above. 

Digital-to-Analog converter 64 receives the YLATCH output signal from B stack 56 in a nine bit, two's 
complement notation, and converts the YLATCH signal into an analog signal representative of human 

15 speech. A detail description of Digital-to-Analog con verter 64 is seen in Fig ures 14a an d b. 

In Figure 14a, there is shown a PLA 641 with inputs YLATCH3, YLATCH4 and YLATCH 5. Another input 
is the signal CLIPP from gate 642. Gate 642 and Gate 643 form a clipping circuit A nine bit two's 
complement signal has a range from -256 to +255. It has been demonstrated that the larger values of a % 
speech waveform convey little intelligence and may be clipped without l oss of esse ntia l intelligenc e. Gates 

20 642 and 643 examin e the two most significant bits of the YLATCH signal (YLATCH 6 and YLATCH7) and the 
sign bit YLATCHSN to determine if the absolute value of the incoming value exceeds 64, a CLIPP or CLIPN 
signal is generated. 

Shift register 640 is a controllable register triggered off gate 644. Gate 644 generates a leading edge of 
the time periods T18 through T3 or T7 through T14, when synthesizer 10 is generating speech. Gate 644 

25 may be disabled by the CLIPN signal, thus preventing a pulse from shifting into register 640. Assuming a 
large negative value is not present, the leading edge propagates down register 640, to an extent controlled 
by PLA 641. The YLATCH values input to PLA 641 will determine how far down register 640 the pulse 
propagates. It should be noted that in the event of a large positive value, CUPP will cause the pulse to 
propagate to the end of register 640. The output gate 644 is coupled directly to gate 645, as are the 

30 complemented outputs of the eight stages of register 640. Therefore, if gate 644 is enabled, gate 645 will act 
as an OR function, and at point X there will be generated a variable width pulse, ranging from one to eighth 
time periods in length. Additionally, the composite'signal comprised of TALK, and T18 through T3 or T7 
through T14 is delayed by gates 646 to form TCOMPD4, a delayed signal. The TCOMPD4 signal is further 
delayed to form a signal called WINDOW. Gates 647 are shown providing the additional half bit of delay; 

35 however, for additional accuracy, the WINDOW signal may be finely adjusted utilizing high speed clock 
signals. The WINDOW signal is required to remove the PULGEN, minimum pulse width, when all inputs are 
zero. The PULGEN signal is required to charge the logics in the programmable delay shown in Figure 14b. 

In Figure 14b is shown a detailed logic diagram of a three stage programmable delay 648 and the 
output speaker drive circuitry. The programmable delay shown in Figure 14 has three stages. Each stage 

40 has a positive or P type device and a negative or N type device above and below it. A zero at point X will 
turn on the P device in stage 1, the N device in stage two and the P device in stage 3, causing PW to be a 
logic one or VDD. Thus a positive pulse out of gate 645 (Figure 14a) will be propagated through 
programmable delay 648 statically. When the pulse ends, or X goes to a logic one, the P device in stage one 
shuts off and the N device conducts. Following this, the output of stage one will go to Vss, or logic zero, 

45 conditionally, base upon the clock gates contained between the P device and N device. The clocked gates in 
stage one are thus capable of extending the pulse-width seen at PW. Stage one is clocked to provide either 
one half of a time period of delay, or no additional delay. Similarly, stage two can provide either one fourth 
of a time period delay, or no additional delay. Stage three also operates similarly; however, a special high 
speed clock 0800 is utilized to provide a delay of one eighth of a time period. Thus, the output at PW is % 

50 either zero, when large negative numbers cause gate 644 to be disabled, or a pulse from one to eight and 
seven/eighths time period in length, with one eighth time period resolution. 

The PW signal is still expressed in two's complement notation, and must therefore be converted to sign 
magnitude data for negative numbers. Gates 649 and 650 are utilized to generate complementary sign * 
magnitude, pulse width modulated signals. The positive numbers are generated by gate 650 (YLATCHSN 

& equal zero) with PW and WINDOW, to eliminate the PULGEN pulses. PW is inverted to effectively convert 
negative numbers (YLATCHSN equal one) to sign magnitude data through gate 649. 

The two pulsewidth modulated values SPK1 and SPK2 are then applied to a push/pull output circuit 
651. Circuit 651 is utilized since it possesses no DC power component, and will effectively drive speaker 18. 

60 



65 



10 



EP 0164 677 B1 



TABLE I 



Equation 


Stage 


Yio(i)=Yi 1 (i)-K 10 b 10 (i-1) 


10 


Y 9 (i)=Y l0 (i)-K 9 b 9 (l-1) 
b 10 (i)=b 9 {i-1)+K9Ye(i) 


9 
9 


Y 8 (i)=»Y 9 (l)-K 8 b 8 (l-1) 
b 9 (i)=b 8 (i-1)+K 8 Y 8 (i) 
Y 7 (i)=Y 8 (i)-K 7 b 7 (i-1) 
*b 8 (i)=b 7 (i-1)+K T Y r (i) 


8 
8 
7 
7 


Y s (i)=Y 7 {i)-K 6 b 9 (i-1) 
b T (i)=b s (i-1)+K 6 Y 9 (i) 


6 
6 


Y 8 (i)=Y 6 (i)-K B b 5 (i-1) 
b 6 (i)=b s (i-1)+K s Y 5 (i) 


5 
5 


Y 4 (i)=Y 6 (i)-K4b 4 (l-1) 
b 8 (i)=b 4 (i-1)+K4Y 4 (i) 


4 
4 


Y,{i)=Y 4 (i)-K 3 b,(l-1) 
b 4 {i)=b 3 <i-1)+K 3 Y 3 (i) 


3 
3 


Y 3 (i)=Y 3 (i)-K 2 b 2 (i-1) 
b 3 (i)=b 2 (l-1)+K 2 Y 2 (i) 


2 
2 


YtOl-YttO-ICIhfl-l) 
b 2 {i)=b,(i-1)+K,Y 1 (i) 


1 
1 


b,(i)=Y n (i) 



35 

Claims 

1. A speech synthesis system comprising: 

—input means (22— Figure 2a) for receiving frames of speech data, said frames of speech data 
40 comprising binary representations of speech-determinative data, wherein each said frame of speech data is 
defined by a binary representation including pitch data, energy data, and filter coefficient data, 

—interpolation means (50— Figure 2b) coupled to said input means for interpolating between adjacent 
frames of said speech data, 

—synthesizer means (50, 52, 54, 56, 58— Figure 2b) coupled to said input means and to said 
45 interpolation means for selectively converting said speech data and interpolated values thereof into signals 
representative of human speech, and 

—means (64, 18— Figure 2b) coupled to said synthesizer means for producing audible sound 
characterized In that said frames of speech data as received by said input means include coded frame 
rate data indicative of a variable time interval between the start of a current frame of speech data and the 
so start of the next successive frame of speech data, and by decoding means (48— Figure 2a) coupled to said 
input means for decoding said frame rate data, said interpolation means being also coupled to said 
decoding means for providing a variable number of interpolation calculations to define interpolated speech 
values between adjacent frames of speech data from last implemented speech data in which the number of 
interpolation calculations and the time interval between the respective starts of adjacent frames of speech 
55 data in a given instance are determined by said frame rate data such that successive frames of speech data 
as respectively defined by a binary representation including pitch data, energy data, and filter coefficient 
data are sequentially delivered to said input means with a time interval therebetween which varies in 
accordance with the decoder value of said coded frame rate data accompanying the speech-determinative 
data of each speech data frame, 
w 2. A speech synthesis system as set forth in claim 1, further characterized by frame control means 
(30— Figure 2a) coupled to said decoding means and said input means for controlling the rate at which new 
frames of speech data are provided to said input means. 

3. A speech synthesis system as set forth in claim 2, further characterized in that said frame control 
means is effective for controlling the rate at which new frames of speech data are received by said input 
65 means in response to frame rate data included in a current frame of speech data, the time interval between 
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the receipt of successive new frames of speech data by said input means being variable and being 
determined by said frame rate data. 

4. A speech synthesis system as set forth in either of claims 2 or 3, further characterized in that said 
interpolation means, is also coupled to said frame control means and is responsive to said frame rate data 

5 for providing the variable number of interpolation calculations between adjacent frames of speech data. 

5. A speech synthesis system as set forth in any preceding claim, further characterized by memory 
means (12 — Figure 1b) for storing selectable speech data, and controller means (14— Figure 1b) operably 
associated with said memory means for controlling the selective accessing of said speech data from said 
memory means, said input means being coupled to said memory means for receiving selected frames of 

10 speech data as accessed under control of said controller means. 

6. A speech synthesis system as set forth in claim 5, further characterized by switch means (16 — Figure 
lb) operably associated with said controller means and responsive to operator commands, said controller 
means being responsive to said switch means for controlling the selective accessing of said speech data 
from said memory means in accordance with said operator commands. 

is 7. A speech synthesis system as set forth in claim 6, further characterized in that said switch means 
comprises a keyboard having a plurality of operator actuatable key switches. 

8. A speech synthesis system as set forth in any preceding claim, further characterized in that said 
variable number of interpolation calculations is 2xn where n is an integer less than one hundred. 

9. A speech synthesis system as set forth in any preceding claim, further characterized in that said 
20 speech synthesis system comprises a portable learning aid. 

10. A speech synthesis system as set forth in any of claims 1 to 8, further characterized in that said 
speech synthesis system comprises a portable calculator device. 

11. A speech synthesis system as set forth in any of claims 1 to 8, further characterized in that said 
speech synthesis system comprises a portable language translator device. 

25 12. A speech synthesis system as set forth in any preceding claim, further characterized in that said 
synthesizer means is effective for selectively converting said speech data into digital signals representative 
of human speech, and said means for producing audible sound comprising digital to analog converter 
means (64 — Figure 2b) coupled to said synthesizer means for converting said digital signals representative 
of human speech into analog signals, and audio means (18 — Figure 2b) coupled to said converter means 

30 for converting said analog signals into audible sound. 

13. A speech synthesis system as set forth in claim 12, further characterized in that said audio means 
comprises a speaker. 

14. A speech synthesis system as set forth in claim 12, further characterized in that said audio means 
includes amplifier means coupled to a speaker. 

35 

Patentanspruche 

1. Sprachsynthesesystem mit 

— Eingangsmitteln (22— Fig. 2a) fur den Empfang von Sprachdatenrahmen, die aus binaren 
40 Darstellungen sprachbestimmender Daten bestehen, wobei jeder Rahmen der Sprachdaten durch eine 
binSre Darstellung mit Tonhdhendaten, Energiedaten und Filterkoeffizientendaten definiert ist, 

— Interpolatlonsmitteln (50— Fig. 2b), die mit den Eingangsmitteln gekoppelt sind und dem Inter- 
polieren zwischen benachbarten Rahmen der Sprachdaten dienen, 

— Synthesizermitteln (50, 52, 54, 56, 58— Fig. 2b), die mit den Eingangsmitteln und den Interpolations- 
45 mitteln gekoppelt sind und die Sprachdaten sowie deren interpolierte Werte selektiv in Signale umsetzen, 
die menschliche Sprache prasentieren, und 

— Mitteln (64, 18— Fig. 2b), die mit den Synthesizermitteln gekoppelt sind und horbare Tdne erzeugen, 
dadurch gekennzeichnet, da (3 die Sprachrahmendaten, wie sie von den Eingangsmitteln empfangen 
werden, codierte Rahmen ratendaten enthalten, die ein variables Zeitintervall zwischen dem Beginn eines 
so gerade vorliegenden Sprachdaten rah mens und dem Beginn des nichstfolgenden Sprachdatenrahmens 
angeben, wobei Decodiermittel (48— Fig. 2a) vorgesehen sind, die mit den Eingabemitteln gekoppelt sind 
und die Rah men ratendaten decodieren, wobei die Interpolationsmittel ebenfalls mit den Decodiermitteln 
verbunden sind, damit eine variable Anzahl von Interpolationsberechnungen zur Definition Interpol ierter 
Sprachwerte zwischen benachbarten Sprachdatenrahmen aus zuletzt erzeugten Sprachdaten definiert 
55 werden, bei denen die Anzahl der Interpolationsberechnungen und daz Zeitintervall zwischen den 
jeweillgen Anfangen benachbarter Sprachdatenrahmen in einem gegebenen Zeitpunkt durch die 
Sprach ratendaten so bestimmt werden, daft aufeinanderfolgende Sprachdatenrahmen, die jeweils durch 
eine binSre Darstellung durch Tonhdhendaten, Energiedaten und Filterkoeffizientendaten definiert sind, 
nacheinander an die Eingabemittel mit einem dazwischenliegenden Zeitintervall gel iefert werden, das sich 
60 entsprechenden dem codierten Wert der Rahmenratendaten verandert, die die sprachbestimmenden 
Daten jedes Sprachdatenrahmens leiten. 

2. Sprachsynthesesystem nach Anspruch 1, gekennzeichnet durch Rahmensteuermittel (30— Fig. 2a), 
die mit den Decodiermitteln und den Eingangsmitteln verbunden sind und die Rate steuern, mit der neue 
Sprachdatenrahmen an die Eingangsmittel geliefert werden. 

65 3. Sprachsynthesesystem nach Anspruch 2, dadurch gekennzeichnet, daft die Rahmensteuermittel die 
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Rate, mit der neue Sprachdatenrahmen von den Eingangsmltteln empfangen werden, in Abhangigkeit yon 
den Rahmenratendaten steuern, die in einem gerade vorliegenden Sprachdatenrahmen enthalten sine), 
sowei das Zeitintervall zwischen dem Empfang aufeinanderfolgender neuer Sprachdatenrahen durch die 
Eingangsmittel veranderiich ist und von den Rahmenratendaten bestimmt wird. 
5 4. Sprachsynthesesystem nach Anspruch 2 oder 3, dadurch gekennzeichnet, daB die Interpolations- 
mittel ebenfalls mit den Rahmensteuermitteln verbunden sind und abhangig von den Rahmenratendaten 
die variable Anzahl der Interpolationsberechnungen zwischen benachbarten Sprachdatenrahmen liefern. 

5. Sprachsynthesesystem nach einem der vorhergehenden Anspruche, gekennzeichnet durch 
Speichermittei (12— Fig. 1b) zum Speichern auswahlbarer Sprachdaten und Steuermittein (14— Fig. 1b), die 

10 den Speichermitteln wirkungsmaBig zugeordnet sind und den selektiven Zugriff auf die Sprachdaten aus 
den Speichermitteln steuern, wobei die Eingangsmittel mit den Speichermitteln gekoppelt sind, damit sie 
ausgewahlte Sprachdatenrahmen entsprechend dem Zugriff unter der Steuerung durch die Steuermittei 
empfangen. 

6. Sprachsynthesesystem nach Anspruch 5, gekennzeichnet durch Schaltermittel (16— Fig. 1b), die den 
is Steuermittein wirkungsmaBig zugeordnet sind und abhangig von Bedienerbefehlen arbeiten, wobei die 

Steuermittei in Abhangigkeit von den Schaltermitteln das selektive Umgreifen auf die Sprachdaten aus den 
Speichermitteln gemaS den Bedienerbefehlen steuern. 

7. Sprachsynthesesystem nach Anspruch 6, dadurch gekennzeichnet, daB die Schaltermittel aus einer 
Tastatur bestehen, die mehrere von einem Bediener betStigbare Tastenschalter aufweist. 

20 8. Sprachsynthesesystem nach einem der vorhergehenden Anspruche, dadurch gekennzeichnet, daB 
die variable Anzahl von Interpolationsberechnungen 2xn betragt, wobei n eine ganze Zahl kleiner als 
Hundert ist. 

9. Sprachsynthesesystem nach einem der vorhergehenden AnsprQche, dadurch gekennzeichnet, daB 
das Sprachsynthesesystem eine tragbare Lernhilfe ist. 
25 10. Sprachsynthesesystem nach einem der AnsprQche 1 bis 8, dadurch gekennzeichnet, daB das 
Sprachsynthesesystem ein tragbares RechengerSt ist. 

11. Sprachsynthesesystem nach einem der Anspruche 1 bis 8, dadurch gekennzeichnet, daB das 
Sprachsynthesesystem ein tragbares Sprachubersetzungsgerat ist 

12. Sprachsynthesesystem nach einem der vorhergehenden Anspruche, dadurch gekennzeichnet, daB 
30 die Synthesizermittel die Sprachdaten selektiv in digitale Signale umsetzen, die menschliche Sprache 

reprSsentieren, und daB die Mittel zum Erzeugen horbarer Tone Digital-Analog-Umsetzermittel (64— Fig. 
2b) sind, die mit den Synthesizermitteln verbunden sind und die menschliche Sprache reprasentierenden 
digitalen Signale in anaioge Signale umsetzen, wobei Ton mittel (18— Fig. 2b) mit den Umsetzermitteln zum 
Umsetzen der analogen Signale in horbare Tone verbunden sind, 
35 13. Sprachsynthesesystem nach Anspruch 12, dadurch gekennzeichnet, daB die Tonmittel einen 
Lautsprecher umfassen. 

14. Sprachsynthesesystem nach Anspruch 12, dadurch gekennzeichnet, daB die Tonmittel einen mit 
dem Lautsprecher verbundenen Verstarker enthalten. 

40 Revendications 

1. Systeme de synthese de la parole comportant: 

— des moyens d'entr£e (22 -figure 2a) pour re ce voir des trames de donnees de parole, lesdites trames 
de donnges de parole consistant en des representations binaires de donnees determinant la parole, dans 
45 lesquelles chacune desdites trames de donnees de parole est definie par une representation binaire 
comprenant des donnees de hauteur, des donnees d'energie et est donnees de coefficients de filtre, 

— des moyens d'interpolation (50-figure 2b) couples avec lesdits moyens d'entr6e pour Interpolation 
entre des trames voisines desdites donnees de parole, 

— des moyens de synth&iseur (50, 52, 54, 56, 58-figure 2b) couples avec lesdits moyens d'entr6e et 
so lesdits moyens d'interpolation pour convertir s§lectivement lesdites donnees de parole et leurs valeurs 
interposes en des signaux reprSsentant la parole humaine, et 

— des moyens (64, 18-figure 2b) couples avec lesdits moyens de synthetiseur pour produire un son 
audible 

caracterise en ce que lesdites trames de donnees de parole, telles que regues par lesdits moyens 
55 d'entrSe, comprennent des donnees de frequence de trames codees indiquant un intervalle de temps 
variable entre le d£but d'une trame en cours des donnees de parole et le debut de la trame qui suit 
imm£diatement des donnees de parole, et par des moyens de dScodage (48-figure 2a) couples aves lesdits 
moyens d'entr6e pour decoder lesdites donnees de frequence en trame, lesdits moyens d'interpolation 
6tant ggalement couples aves lesdits moyens de dgcodage pour produire un nombre variable de calculs 
so d'interpolation pour definir des valeurs de parole interposes entre les trames voisines des donn6es de 
parole, a partir des dernieres donnees de parole realisees dans lesquelles le nombre des calculs 
d'interpolation et I'intervalle de temps entre les debuts respectifs de trames voisines des donndes de parole 
dans un cas donne sont d6termin6s par lesdites donnies de frequence de trame de maniere que des 
trames successives de donnees de parole telles que definies respectivement par une representation binaire 
65 comprenant des donnees de hauteur, des donnees d'energie et des donnees de coefficients de filtre soient 
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d£livr6es sequentiellement auxdits moyens d'entr6e avec un interval le de temps entre elles qui varie en 
fonction de la valeur decodes desdites donnees de frequence de trame codees accompagnant les donn6es 
de determination de parole de chaque trame de donnees de parole. 

2. System e de syn these de parole selon la revendication 1, caracterise en outre par des moyens de 
5 commande de trame (30-figure 2a) couples avec lesdits moyens de decodage et lesdits moyens d'entr6e 

pour commander la frequence a laquelle des nouvefles frames de donnees de parole sont produits pour 
lesdits moyens d'entree. 

3. Systeme de synthdse de parole selon la revendication 2, caract6ris6 en outre en ce que lesdits 
moyens de commande de trame ont pour fonction de commander la frequence a laquelle des nouvelles 

10 trames des donnees de parole sont recues par lesdits moyens d'entree en reponse aux donnees de 
frequence de trames incluses dans une trame en cours de donnees de parole, I'intervalle de temps entre la 
reception de nouvelles trames successives de donnees de parole par lesdits moyens d'entree etant variabfe 
etant determine par lesdites donnees de frequence de trame. 

4. Systeme de synthdse de parole selon la revendication 2 ou 3, caracterise en outre en ce que lesdits 
?s moyens d'interpolation sont egalement couples avec lesdits moyens de commande de trame et reagissent 

auxdites donnees de frequence de trame en produisant le nombre variable de calcul d'interpolation entre 
des trames voisines de donnees de parole. 

5. Systeme de synthese de parole selon Tune quelconque des revendications precedentes, caracterise 
en outre par des moyens de me mo ire (12-figure 1b) pour memoriser des donnees de parole pouvant etre 

20 selection n6es et des moyens de commande (14-figure 1 b) associds en fonctionnement avec lesdits moyens 
de memoire pour commander I'acces selectif desdites donnees de parole dans lesdits moyens de memoire, 
lesdits moyens d'entree etant couples avec lesdits moyens de memoire pour recevoir des trames 
selectionnees de donnees de parole, acc^dees a fa commande desdits moyens de commande. 

6. Systeme de synthese de parole selon la revendication 5, caracterise en outre par des moyens de 
25 commutation {16-flgure 1b) associes en fonctionnement avec lesdits moyens de commande et reagissant a 

des commandes de I'operateur, lesdits moyens de commande reagissant auxdits moyens de commutation 
en commandant i'acces selectif desdits donnees de parole dans lesdits moyens de memoire en fonction 
desdites commandes de l f op6rateur. 

7. Systeme de synthese de parole selon la revendication 6, caract6ris6 en outre en ce que lesdits 
30 moyens de commutation comprennent un clavier avec plusieurs commutateurs a touches pouvant Stre 

actionnes par un op6rateur. 

8. Systeme de synthese de parole selon I'une quelconque des revendications prec&dentes, caracterise" 
en outre en ce que ledit nombre variable des calculs d'interpolation est 2xn, ou n est un entier inferieur a 
cent. 

35 g. Systeme de synthese.de parole sejon Tune quelconque des revendications pr$c£dentes, caracterise" 
en outre en ce que ledit systeme de synthese de parole consiste en une aide portative a I'enseignement. 

10. Systeme de synthese de parole selon I'une quelconque des revendications 1 a 8, caracterise en 
outre en ce que ledit systeme de synthese de parole consiste en un dispositif calculateur portatif. 

11. Systeme de synthese de parole selon I'une quelconque des revendications 1 a 8, caracterise en 
40 outre en ce que ledit systeme de synthese de parole consiste en un dispositif portatif de traduction de 

langage. 

12. Systeme de synthese de la parole selon Tune quelconque des revendications precddentes, 
caracterise en outre en ce que lesdits moyens synthetiseurs ont pour fonction de converter seiectivement 
lesdites donnees de parole en des signaux numeriques representant une parole humaine, et lesdits 

45 moyens de production de son audible consistant en des moyens de convertisseur numerique-analogique 
(64-figure 2b) couples avec lesdits moyens synthetiseurs pour convertir lesdits signaux numeriques 
reprisentant une parole humaine en des signaux analogiques, et des moyens de son (18-flgure 2b) couples 
aves lesdits moyens convertisseurs pour convertir lesdits signaux analogiques en un son audible. 

13. Systeme de synthese de parole selon la revendication 12, caracterise en outre en ce que lesdits 
so moyens de son comprennent en un haut-parieur. 

14. Systeme de synthese de la parole selon la revendication 12, caracterise en outre en ce que lesdits 
moyens de son comprennent des moyens d'amplificateur couples avec un haut-parieur. 
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